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Abstract 

This note studies feedforward circuits as models for perfect adaptation to step signals in biological 
systems. A global convergence theorem is proved in a general framework, which includes examples 
from the literature as particular cases. A notable aspect of these circuits is that they do not adapt 
to pulse signals, because they display a memory phenomenon. Estimates are given of the magnitude 
of this effect. 
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1 Introduction 

Feedforward circuits have been often proposed for adaptation to constant signals in biological sys- 
tems. Indeed, the review paper gives a chemical reaction model, called there a "sniffer" and 
shown in Figure [T} as the paradigm for perfect adaptation. The chemical species S acts as a "sig- 
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Figure 1: "Sniffer" network, from 



nal", and the species R is viewed as a "response" element. The third species, X, is an intermediate 
species. The species S directly helps promote the formation of R (arrow labeled "fci"), and also the 
formation of X (arrow labeled "/ca"). On the other hand, X also enhances degradation of the species 
R (vertical arrow labeled "^2"), and thus S also acts through X as an inhibitor of R, counteracting 
the positive direct effect. This "incoherent" counterbalance between a positive and a negative effect 
gives rise to a regulation property. 

Mathematically, the model is described in as a system of two coupled differential equations 
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for the concentrations of the substances in question, using mass-action kinetics: 



X = kss — k^x (la) 
r = kis — k2xr (lb) 

where dot is used to indicate time derivative. The key fact is that in steady state and for nonzero 
constant signals 5", the concentration of R equals and this value is independent of the actual 
value of S. (This follows simply by setting the right-hand sides of the equations to zero and solving 
for r.) 

Similar constructions have been given in other biological investigations of adaptation, notably 
in [30], where various possible chemical networks are proposed for modeling adaptation by the 
chemotaxis pathway of Dictyostelium. 

A common feature of these models is that they have the form of a stable linear system which 
in turn drives a one-dimensional (generally nonlinear) system, whose state-variable represents the 
response that should adapt. The interconnection is set up so that the whole system becomes a 
"feedforward circuit" [1]. 



General framework 

The strength of the external input signal (a non-negative real number) will be denoted by m, the 
state of the linear system (an n-dimensional vector) by x, and the state of the driven response 
(a real number) by y. Then, a mathematical description of the evolution of concentrations of the 
various signals is given by a system of n + 1 differential equations as follows: 

X = Ax + hu 

(2) 

y = c{y)x + d{y)u 

where A and h are a constant stable matrix and column vector respectively, A G M"^", h G M"^^, 
and c(?/) and d{ii) are continuous functions of y so that, for each c(?/) G M^^" and diy) G M. 
System Q is a system with inputs and outputs, in the standard sense of control theory [23]. The 
state variables x{t) and y{t) take values in some subsets A" C M" and 3^ C M respectively, where y 
is a closed, possibly unbounded, interval. The sets X and y can be used in order to impose non- 
negativity and/or mass conservation constraints. Enough regularity is assumed so that, for every 
non-negative constant input Mq, and every initial condition (a;o, yo) E X y, the equations ^ have 
a unique solution {x(t),y(t)) & X x y defined for all t>0. 

For example, in the "sniffer" reactions ([!]) from [26], and writing u, x, and y instead of s, x, and 
r respectively, one has X = y = ]R>o, A = —k^, b = k^, c{y) = —k2y, and d{y) = ki (constant). In 
these notations Equations ([T]) become: 

X = —k^x + k^u (3a) 
ij = —k2xy + kiu. (3b) 



Adaptation to step inputs 

For each nonzero constant input Ug, the steady states (a;o, yo) of the system (|2]) are obtained by first 
setting i; = 0, which gives xq = -A-^buo (the inverse is well-defined because A was assumed to be 
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stable, and in particular all its eigenvalues are nonzero), and then substituting into the left-hand 
side of the ^/-equation. There obtains the following algebraic equation: 



d{y) - c{y)A-^h = (4) 

(after canceling out uq 7^ 0). A key hypothesis made from now on (and which is satisfied in all the 
cited examples) is that there is a unique solution y = yo of the algebraic equation Q, and that this 
solution is an asymptotically stable state for the reduced system 

y = {d{y) - c{y)A-'b)uo 

that would result if x{t) were already at its steady state —A^^buQ. To be precise, the following 
hypothesis will be imposed: 

{3yoey){yyey) [{y-yo) {d{y) - c{y)A-'b) <0] (H) 

(that is, y = {d{y) — c{y)A^^b)uo is positive when y < y^ and negative when y > yo). It is 
fundamental to observe that yo (though not, of course, Xq) is independent of the particular numerical 
value of Mq. 

Proposition 2.1 shows that, assuming boundedness of trajectories, systems ^ "adapt" to 



nonzero constant signals Uq ("step signals"), in the sense that all the solutions of the system ^ 
converge to the above steady state {xo,yo), where yo is independent of uq. 

Take again as an example the equations ^ from now with all ki = 1, Figure |T|b) plots 
the response to the piecewise constant input with nonzero values that is shown in Figure jlTa). It is 
clear that this response adapts to the value yo = 1- 



Memory of pulse inputs 

One of the main objectives of this note is to bring attention to the following additional facts. When 
Mo = 0, that is, in the absence of an external signal, steady states are no longer unique. Indeed, any 
vector of the form {0,y) is a steady state. This has an important consequence for the behavior of 
system ^ when a pulse input is used. A pulse is defined here as an input u which has the following 
form: u(t) = Mq 7^ for some interval t G [0, T], and u(t) = for t > T. Suppose that the interval 
is long enough (T ^ 1) so that one may assume that x{T) and y{T) are (approximately) in steady 
state: x{T) ^ —A^^buo and y{T) ^ yo. Upon removal of the external excitation at time T, the 
equations for the system become x = Ax and y = c{y)x for t > T, with initial conditions x{T) 
and y{T), so x{t) f» —e^^'^^'^A'^buo for t > T. The solution of y = c{y)x starts at yo but adds a 
quantity which integrates the effect of the nonzero function x{t). The response may then settle to 
a new value which is different than the adapted value yo- 

Thus, feedforward systems for adaptation as those discussed here exhibit a "memory" effect 
with respect to (ideal) pulses. This phenomenon was apparently not remarked upon earlier. The 
present note discusses the effect and provides estimates. 

To illustrate the phenomenon with the simplest possible (if not biologically meaningful) example, 
take n = 1, A = —1, 6=1, ciy) = —1, and d{y) = 1. One has that y ~ —e^~^uo, so y{t) yo—uo < 
?/o as t — s> 00 (assuming that uq > 0). In fact, the larger the mq, the smaller the new asymptotic 
value yo — uo is. For the nonlinear equations (|3| from [26j, the same phenomenon holds. Taking all 
ki = 1, Figure[T|d) plots the response to a pulse of unit amplitude and Figure [l|^f) plots the response 
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Figure 2: Plots for example discussed in text. In left column are inputs u{t), in right column 
are responses y{t). Initial conditions are x(0) = y{0) = 0. u{t) is constant up to time t = 5, 
switches to another constant value at time t = 5. (a,b) u switches to a nonzero value, y adapts 
again. (c,d) Pulse of magnitude 1: asymptotic value of ?/ is ~ 1/e ~ 0.37 after pulse. (e,f) Pulse of 
larger magnitude 2: asymptotic value of y is smaller: ^ 1/e^ ~ 0.14 after pulse. (g,h) Exponential 
decaying u{t) = 2e^*~^^/^° after time t = 5 results in return to close to adapted value y{oo) ~ 0.9 
{u{t) plotted only on interval [0, 10] for ease of comparison). 



to a pulse of twice the amplitude. Once again, the response settles to a value that is smaller when 
the amplitude of the pulse was larger. The sharp cut-off of an ideal pulse plays an important role 
on this "memory" effect: when the input instead returns slowly enough to its baseline value, an 
almost-adapted response is recovered, as shown in Figure llVh). 



Feedforward motifs in systems biology 



Feedforward circuits are ubiquitous in biology, as emphasized in pp|, where (incoherent) feedfor- 
ward circuits were shown to be over- represented in E. coli gene transcription networks compared to 
other "motifs" involving three nodes. Similar conclusions apply to certain control mechanisms in 
mammalian cells [T3j. A large number of papers have been devoted to the signal-processing capabil- 
ities of the feedforward motif, notably [15] which looked into its properties as a "change detector" 
(essentially, sensitivity to changes in the magnitude of the input signal), and [3] which studies its 
optimality with respect to periodic inputs. Comparisons with other "three node" architectures 
with respect to the trade-off of sensitivity versus noise filtering are given in [8]. Other references 
on feedforward circuits include ^22j (showing their over-representation at the interface of genetic 
and metabolic networks), [28] (classification of different subtypes of such circuits), and [10] (clas- 
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sification into "time-dependent" versus "dose-dependent" biphasic responses, which are in a sense 
the opposite of adaptated responses). The latter reference provides a large number of additional 
incoherent feedforward input-to-response circuits, including: EGF to ERK activation [211 CEj, glu- 
cose to insuhn release [TTl [12], ATP to intracellular calcium release [HI nitric oxide to NF-kB 
activation [20], microRNA regulation [25], and many others. Dealing specifically with adaptation 
properties of feedforward circuits, and in addition to the papers [26], |30], are the paper [29] on 
micro RNA-mediated loops, and fTT], which deals with the role of feedforward structures in the 
robust behavior in E. coli carbohydrate uptake via the carbohydrate phosphotransferase system (an 
analogous metabolic mechanism is also discussed in [27]). 

Outline of paper 

Section[2]has statements of the convergence results. Section[3]has a brief discussion of "approximate" 
adaptation by feedforward circuits. Section |4] shows estimates of the magnitude of the pulse memory 
effect. Section[5]has the proofs of the convergence results. Section|6]revisits the motivating examples 
and also briefly discusses the systems in [TT] [22] • Finally, it is known that, under appropriate 
technical assumptions, perfect adaptation implies that the system may be written, after a suitable 
nonlinear change of coordinates, as a system in which the integral of the regulated quantify is 
fed-back, see for instance [6l [TJ [311 |2l]. This fact is not incompatible with the system being a 
feedforward system, as remarked in Section [7} Section |8] summarizes the results and speculates on 
their significance. 

2 Statements of convergence results 

The main convergence result is as follows. Note that, since the x-coordinate of a solution {x{t),y{t)) 
for constant u always converges (because of the stability assumption on the linear system) and hence 
is bounded, asking that {x(t),y(t)) is bounded is the same as asking that y(t) is. 

Proposition 2.1 Suppose that Property (H) holds. Then, for each step input u = Uq 0, and 
every initial condition, if the corresponding solution {x{t),y{t)) of ^ is bounded, then it converges 
to (xo,i/o)- 

Boundedness is automatically satisfied if y is itself a bounded interval, as is the case if mass 
conservation laws constrain the system dynamics. More generally, the following condition can be 
helpful. It strengthens Property Property (H) for small and for large values of y: 

(Vmo > 0)(3£ > 0) 

{^y2ey)(Wy2<yey) [\c{y)\e + uo{d{y)-c{y)A-'b) < O] (H*) 
(3yiG3^)(Vi/i>yG3^) [~\c{y)\e + Uo{d{y)-c{y)A-'b) > O] 

(where |c| denotes the norm of the vector c) and it says that the inequality in (H) is preserved 
under small enough perturbations proportional to c{y), as long as y is large or small enough. 

Lemma 2.2 Suppose that (H) and (H*) are satisfied. Then, for each step input u = uq 0, and 
every initial condition, the corresponding solution {x{t),y{t)) of (|2| is bounded. 
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From Proposition 2.1 and Lemma 2.2 there is the following immediate consequence: 



Corollary 2.3 Suppose that (H) and (H*) are satisfied. Then, for each step input u = uq 0, 
and every initial condition, the corresponding solution {x{t),y{t)) of ^ converges to {xo,yo). 

Condition (H*) is often automatically satisfied in examples: 

Lemma 2.4 Suppose that c{y) and d{y) are affine in y. That is, there are two row vectors cq, ci G 
M^^" and two scalars do,di such that c{y) = cq + yci and d{y) = do + ydi. Then, Property (H) 
implies Property (H*). 



3 Approximate adaptation 

Perfect adaptation is an ideal mathematical property. In biological systems, regulated behavior 
may break down due to dilution, turn-over due to gene expression and protein degradation, and 
other effects, especially over long time intervals. From a modeling viewpoint, it is thus interesting 
to study mechanisms which provide "approximate" adaptation, in the sense that the response of 
the system remains approximately constant, as long as parameters (kinetic constants, production 
rates, degradation rates) stay within appropriate ranges. The reader is referred to the papers [HI [2] 
for formulations of certain approximate adaptation mechanisms for linear and nonlinear models. 
This section discusses a few general facts, and works out details for a particular class of systems. 



to be illustrated with an example in Section 6.5 



One general fact is that a perturbation of the right-hand side of a differential equation results 
in small perturbations of trajectories, on bounded intervals of time. Specifically, suppose that x{t) 
is the solution of a set of differential equations x = f{x), with initial condition a;(0) = Xq, and 
consider any fixed time interval [0,T]. Next, consider a perturbed equation i = f{z) + h{z), and 
let z{t) be its solution with the same initial condition z{0) = xq- Then, if the vector field "/i" 
is small in an appropriate sense (uniformly, for instance, or more generally if its integral along 
trajectories is small), then it follows that z{t) ^ x{t) for all t e [0, T]; see Theorem 55 in Appendix 
C of [23] for details. In principle, and in the absence of additional stability assumptions, the 
theoretical estimates tend to be conservative, in that the guaranteed approximation is very poor as 
T increases. However, in practice the approximation may be quite good. As an illustration, consider 
once again the "sniffer" reactions ([s]) from [26], and suppose that one perturbs the right-hand side 
of the equations by adding saturated terms: 

X = —K4X + ksu + 



y = —k2xy + kiu + 



Ki + y 
V2X 



K2 + X 



representing cross-activating feedbacks. Using the step input from Figure [T]^a), Figure |3] compares 
the results of simulations (starting from the zero initial state) of the original and the perturbed 
systems, when all constants have been chosen as 1. Notice that the perturbed system has a response 
which is quite close to that of the original system, on the given interval. 
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Figure 3: Approximate adaptation: comparison of responses when right-hand side of equation is 
perturbed as discussed in text. Input is as in Figure [l]^a). Sohd hne is for original system and 
dashed hne for perturbed system. 



Another sense of approximate adaptation to step inputs is when adaptation behavior happens 
only for input signal values in a restricted range. This is illustrated next, using a perturbation of 
the "sniffer" reactions ^ from [26]. Suppose that the equations are as follows: 

X = —k^x + k^u + r(t/) (5a) 
y = -k2xy + kiu-p{y). (5b) 

The term p{y) may represent, for example, a linear or nonlinear degradation effect for the species 



y, while r{y) might represent an activating feedback. (In Section 6.5, it will be shown that a 
microRNA-based feedforward loop studied in the literature can be represented, after a coordinate 
change, in this form.) The steady state corresponding to a given constant input u = uq can be 
found as follows. Setting the right-hand sides of ^ to zero and solving the first equation for x gives 
X = -^{k^u + r{y)). The expression for x is then substituted in the second equation, to provide the 
following relation for u in terms of y: 

Suppose that p(0) = and that k2yr{y) + k^piy) is an increasing function of y (this happens 
automatically if, for example, p{y) and qiij) are non-negative and increasing functions of y). Then 
Q is an increasing function on the interval < ?/ < a = with (5(0) =0 and a pole at a, see 
Figure [3} The function Q can be then inverted, so as to obtain y as a function of u, y = Q'^{u). 

For every step input u whose amplitude is large enough, the steady state value of the response 
y is close to a. In that sense, "approximate" adaptation holds. One way to characterize this effect 
is as follows. Define K = Q{a/2). This number plays a role analogous to that of a "half maximal 
effective concentration" or "EC50 value" in pharmacology and biochemistry: for any input value u 
larger than K, y is within a/2 and a. 

For example, if p{y) = ky (linear degradation/dilution) and q{y) = 0, then y = Q~^{u) = 
for appropriate numbers V and K. For u > K, the response value is within V/2 and V. 
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y 



Figure 4: The function Q 



4 Pulse memory effects 

As remarked in the Introduction, when a pulse input u{t) is apphed to the system ([2]), the asymptotic 
value of y does not typically return to its adapted value. There is a "memory" effect as the 
asymptotic value of y depends on the magnitude of the step. Thus, this section analyzes the 
effect of a pulse input, that is u(t) = uq for some interval t G [0,T], and u(t) = for 
t > T. The underlying assumption is that the interval is long enough (T ^ 1) so that x{T) and 
yiT) are (approximately) in steady state: x{T) ^ —A~^buo and y{T) f» yQ. This means that 
x{t) ~ —e^^~^^^ A~^buo for t > T, and y approximately solves y = —c{y)e^^~^'^^A~^buo starting at 
the adapted value yo. 

Therefore, and changing for simplicity the origin of time to t = T, one wishes to estimate the 
limiting value of the solution of the initial- value problem: 

y = -c{y)e'''A-'buo, y{0) = yo ■ (6) 

In general, such a differential equation, even though scalar, is not easy to solve, because of the time 
dependence. Two special cases are as follows. 

4.1 AfRne case 

When c{y) = Cq + yci is afiine in y, one may write ^ as: 

y + a{t)y = p{t) 

where a{t) = cie^^A~^buo and P{t) = —coe^^A~^buo. This is a linear differential equation, which 
can be solved in a standard manner by using the integrating factor e-^"^*^'^*. 

4.2 Separable case 

Another special case is that in which one may decompose c{y) as follows: 

ciy) = e{y)c (7) 
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where 6{y) is a nowhere vanishing scalar continuous function of y, and c is a row vector. Details in 
this special follows. 

Separating variables, 

J'^'^ = -c(^j\'^d.^A~^huo = c{l-e'^)A-%uo. 

The function Qoiv) '■= Jy^ ^fy is strictly increasing or strictly decreasing if 9 is positive or negative 
respectively, so its inverse G := Og^ is well defined, as it is also strictly increasing or strictly 
decreasing respectively. 

One concludes that: 

Vuo = {cA~%uo) 

is the steady-state value of y after the system has been subjected to a long pulse of amplitude uq 
and the pulse is removed. Recalling the conditions under which B is increasing or decreasing, one 
may summarize as follows: 

Proposition 4.1 Assuming the form in ([t]), with 9(y) nonzero and continuous on 3^, the steady 
state value jjuo is: 

(a) an increasing function of uq if 9{yo)cA~'^b > 0, and 

(b) a decreasing function of uq if 9{yQ)cA"'^b < 0. 

Notice that 6(0) = yo, so the steady state yug after a pulse is smaller (respectively, larger) 
than the adaptation steady state y^ (that results after a step input) provided that 9{yo)cA^^b < 
(respectively, > 0). 



4.3 Non-ideal pulses 

Observe that, while the previous analysis concerned only ideal pulses (the value of u{t) returns 
exactly to zero after time t = T), approximately the same phenomenon will still occur if u merely 
returns to a "small" value, in the following sense. Suppose that u{t) = Uq ^ for some interval 
t G [0, T], and u{t) = e for t > T, where e is sufficiently small. The asymptotic value of the response 
y will eventually converge to the adapted value yo, if e ^ 0. However, if e ^ 0, this convergence 
to yo will be extremely slow, as the behavior will be close of that for ideal pulses. Mathematically, 
this fact is a trivial consequence of the continuous dependence of solutions of differential equations 
on parameters (on finite time intervals). 

To formulate this property precisely, call z{t) the value of y{t) that would correspond to the 
ideal pulse {u(t) = for t > T), and yeit) the value that corresponds to the input with u(t) = e for 
t > T. The subscript e is used to emphasize the dependence on the numerical value of e. For any 
fixed time T' > T, it holds that yeiT') z{T'), in the sense that VeiT') — > z{T') as e — > 0. (See for 
example. Theorem 1 in [23] for a proof; explicit estimates of convergence can be obtained using the 
Gronwall inequality, as discussed in that textbook.) 

Another way in which a pulse may differ from an ideal pulse is if the cut-off to u{t) = is 
not sharp. In fact, current microfluidics technologies allow one to produce pulsatile-like inputs to 
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cell signaling systems, but these might exhibit a slow decay at the tail end. (The same effect may 
manifest itself in real systems, when an intermediate species stands between the input and the x 
and y variables.) If the cut-off is sharp enough, a continuity argument similar to the one explained 
for pulses that sharply return to a constant value 7^ applies. However, for slower decays to m = 0, 
the asymptotic value of the response may indeed return to close to adapted values, as was earher 
illustrated with an example, see Figure [l|^h). 



5 Proofs 

The following is an elementary observation about scalar differential equations. 

Lemma 5.1 Consider the scalar time-dependent differential equation 

y = F{t,y) + ip{y) 

where F and cp are differentiable functions. Assume that F{t,y) ast ^ 00 uniformly ony & K, 
where i^' C M is a closed and bounded interval, and that there is some y^ E K such that ip{y) > 
for all y < yo and ip{y) < for all y > yo. Then, every solution y : [0, 00) — > is so that y(t) — > yo 
as t — i> cx). 



Proof. Let y{t) be a solution with values in K, and pick any open neighborhood of yo- We must 
show that, for some T, y{t) G for all t > T. The set K \ N is the union of two closed and 
bounded sets A_ and yl+ (either of which might possibly be empty, if yo is an endpoint of K) such 
that y G A_ =^ y < yo and y G =^ y > y^. By continuity of the function y?, there is some 
positive number 5 such that (piy) > 5 for all y G A_ and (p{y) < —5 for all y G Aj^. For some t^, 
\F{t,y)\ < 5/2 for all y G A:\A^ and all t > to. Thus, for t > to we have that y{t) > 5/2 iiy{t) G A_ 
and y{t) < —5/2 if y{t) G A^. This means that for some T > to it will hold that y(t) exits K \ N 
and does not enter again, as needed. I 



Proof of Proposition 2.1 



We will apply Lemma 5.1 Suppose that Property (H) holds. Pick any step input u = uo ^ 
and an initial condition of (|2]), and suppose that the corresponding solution {x{t),y{t)) of ^ is so 
that y{t) is bounded. Since ^ is a closed set, this is the same as saying that y{t) G K for all t, for 
some closed and bounded interval K (1 y. We have that x{t) = 9{t) — A^^huo for all t > 0, where 
6{t) = e*^ {xq + A~^buo) and therefore y satisfies: 

y = F{t,y) + ^{y) = c{y)e{t) + ^{y) (8) 

where (p{y) = {d{y) — c{y)A^^b)) Uq. Property (H) gives the property needed for cp in the Lemma. 
On the other hand, 9(t) (as e*^ 0, by stability), so F(t,y) uniformly on y E K. Thus, 



Lemma 5.1 gives the desired conclusion. 
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Proof of Lemma 12.21 



We pick any initial condition, and want to show that the corresponding solution y{t)) of (|2| is 
such that y(t) is bounded. We will prove that y(t) is upper-bounded, the lower bound proof being 
similar, and assume that 3^ is not upper bounded, since otherwise we are done. By Property (H*), 
we may pick e > and y2 ^ y such that \c{y) \ e + ipiy) < for all y > y2, where the function ip is 
as in the proof of Proposition 2.1, By (jsj), we know that y{t) < as long as y{t) > y2 and t > to, 



where to is picked so that \9{t)\ < e for all t > to- This clearly implies that y{t) is upper bounded. 



Proof of Lemma 12.41 

Suppose that c{y) and d{y) are affine in y, c{y) = cq + yci and d{y) = do + ydi. As Property (H) 
holds, 

fi + I'y = do + ydi — (cq + yci)A^^b < 
for y > yo, y & y, where we are writing fi := do — CoA~^b and u := di — CiA~^b. 

Fix any uq > 0. We need to show that Property (H*) holds. We will show the existence of e 
and 1/2; existence of 2/2 is proved in a similar way. Our goal is to pick 1/2 £ 3^ in such a way that 

\c{y)\e + uo{d{y)-c{y)A-'b) <0 (9) 

whenever y > y2 is an element of 3^. If the interval y is upper bounded, we may pick y2 equal to 
its right endpoint, and this property is satisfied vacuously. Thus, we assume from now on that y is 
not upper bounded. 

We claim that u < 0. Indeed, if z/ > then n + uy > jj, + uyo = for any y > yo, y & y, which 
would contradict Property (H). (Note that there exist such y > yo, because yo cannot be the right 
endpoint of y, because y is not upper bounded.) 

For ([9]) to be satisfied, and assuming we pick 1/2 > 0, it is enough that this inequality should 
hold: 

(|co|e + Mo/i) +?/(|ci|£ + MoZ/) < (10) 

(because |co + ciy\ < \co\ + \ci\ y). We let e := — 2|c7jW ^'^^ 1/ > 0; 

{\co\e + uofi) + y {\ci\e + uoi^) < {\co\e + uofi) + yuoi^/2 
and, since the upper bound is a linear function with negative slope, it will be negative for large y. I 



6 Examples 

We show here how the results apply, in particular, to the models in the papers and [30]. 



6.1 "Sniffer" model 



The "perfect adaptation" model in is, after a renaming of variables and a slight rearranging 
to bring into the form (2), as shown in (^3). Here yo = and (H) is satisfied because d{y) - 
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2.4 



so 



c{y)A = ki — ^j^y changes sign at y = y^. This example has the form in Lemma 
convergence holds. 

To study the effect of pulses, we write c{y) in the form ([7| using c = — ^2 and 6{y) = y. So 
0o(y) = Jy^ dz/z = \n{y) - \n{yo) = \n{y/yo). It follows that Q{r) = yoe", so 

yuo = 2/0 exp I — p-uo 

which decreases with uq. 



6.2 Dictyostelium chemotaxis models from [130 



There are several models given in [30], but they all have the same general interpretation. The 
authors of [30], based on previous work [12|, postulate the existence of a "response regulator" R, a 
variable that correlates to the chemotactic activity of the system, that can be in an "active" or in an 
"inactive" form. The activation and inactivation of R are regulated by a pair of opposing processes: 
an excitation process that induces an increase in the level of the response R, and an inhibition 
process that lowers this response. The input to the system is the extracellular chemoattractant 
concentration, and it is assumed that this signal triggers increases in concentrations in both the 
activation and inactivation elements. We denote by y{t) the concentration of active regulator, by 
a — y{t) the concentration of inactive regulator, where a is the total concentration ( act ive+ inactive), 
assumed constant, and by Xi{t) and X2{t) the concentrations of the activation and inactivation 
elements respectively. 

There are several alternative models given in [30]. The first one is, in our notations: 

Xi = —kiXi + 
X2 = -k3X2 + kiU 
y = k^^a - y)xi - keyx2 

where the fcj's are positive constants. This has the form with X = ]R>o, y = [0,a], c{y) = 
(/c5(q; - y), -key), and d{y) = 0. To simplify notations, let us write P = ^ and Q = Note 
that Property (H) is satisfied, as the solution yo of 

P{a-y)-Qy = (11) 

belongs to the interval (0, a), and the algebraic expression changes there from positive to negative. 
The y-dynamics is bounded, by definition, so we have convergence. 

Since the y equation is affine, the memory effect of pulses can be obtained by solving an ap- 
propriate linear differential equation, as explained earlier, but the expression for the solution is 
algebraically very involved. We can, however, make some qualitative remarks. 

Lemma 6.1 The solution of the initial- value problem 

y = P{a- y)e~''^'uo - Qye-''''uo , 2/(0) = yo (12) 
has a limit jjuo- If ^3 > then y^^ > yo, and if k^, < ki then < yQ. 
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Proof. We assume that > ki, the case k^ < ki is proved in an analogous fashion. Since y(t) is 
bounded, it will be enough to show that there cannot exist two limit points < ?/i < ?/2 < ^ of 
the solution. So assume that such points exist, and let < ti < Si < ^2 < ■S2 • • • ^ oo be so that 
y(ti) — > l/i as i — 00 and y{si) ^ I/2 as i ^ 00. Pick e := ^(|/2 — yi) + (a — I/2) > and some time 
i > such that Pe > aQe'^^^~^'-^^^ (there is such a i because /ci — /C3 < 0). 

Note the following property: 

y{t) < a - e and t > t =^ y{t) > . (13) 

Indeed, 

—y = p{a - y{t)) - Qy{t)e^^^-^^^' > Pe- Qae^^^-^'^' > 

because a — y{t) > e and y{t) < a, so y{t) > as claimed. 

Since I/2 > a — e, there is some i so that y{si) > a — e. Without loss of generality, we may 
assume that was picked larger than i. Then, 

t > Si ^ y{t) >a-e. (14) 

(Otherwise, there would exist some a < a — 5 and some T > Si such that y{T) = a, and we can 
assume that T has been picked smallest possible with this property, for the given a. Pick 6 > 
so that Si < T — S and so that the interval / = {T — S,T] has the property that y{I) C [0,a — e). 



Then, by property (13), y{t) > for all t G L So y{t) < y{T) for all t G I, which contradicts the 
minimality of T.) 



On the other hand, since yi < a—e, y{tj) < a — e for all sufficiently large j. This contradicts (14) 
if j > i. The contradiction shows that such yi < y2 cannot exist, so the function y{t) is convergent 
as t ^ 00. 

We must now prove that fjuo > Vo- Since yo solves (11), and e^^^~^^'^^ < 1 for all t > 0, it follows 



that P{a - yo)e-^'^ - Qy^e'^''^ > for all t > 0. Thus: 

y{t) = P{a - y{t))e-''^' - Qy{t)e-'^' > P{a - yo)e-''' - Qyoe~''' > 

whenever t > is such that y{t) < yo. This implies that y{t) > y{0) = yo for all t > 0. Therefore 
the limit also satisfies yuo > yo- ■ 



The interpretation of Lemma 6.1 is obvious: k^ > ki means that the inhibitor (^2) degrades 
at a faster rate than the activator {xi). Thus, when the external signal is turned-off, there is a 
residual effect due to the additional activator still present, which implies a positive memory effect, 
in the sense that the response is higher than its value at m = 0. Similarly, when ^3 < fci, there is 
additional repressor present and the memory effect is negative (that is, lower than when m = 0). 

The other models from |30j are similar, differing only in the placement of the feedforward terms 
in the y equation, and the stability results apply equally well. Let us consider one of the variants: 

Xi = —kiXi + k2U 
X2 = -kzX2 + kiXi 
y = k^{a - y)u - kQyx2 . 

Note that the activator now acts so as to enhance the inhibitor, and the input signal acts directly 
on the response element. This has the form d2|), with X = M>q, y = [0,q;], c{y) = (0, —k^y), and 
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d{y) = k^{a — y). Note that Property (H) is satisfied, as A;5(q; — y) — ^^^^U changes sign at a 
7/0 G (0, a). The y-dynamics is bounded, by definition, so we have convergence. 

Once again, since the y equation is affine, the memory effect of pulses can be computed using 
linear differential equations theory. The memory effect is in this case decreasing in Uq, independently 
of the parameters ki > 0. This is because the initial value problem after the signal has been turned- 
off has the form: 

m = -ymt) 

for some positive function 9{t), so y{t) < for all t. Intuitively: the activation effect (u) turns-off 
immediately, but there is a residual inhibition effect (^2). 

As an concrete illustration, let us work out the case in which all constants are equal to 1. In 
this case, solving {1 — y) — y — gives yo — 1/2, and is the limiting value of the solution of: 

y = -ye-\t + l)uo 

(because X2(t) = e~\t + l)uo). Thus, y{t) — ie[(2+*)e"'-2]wo ^^(j therefore = |e~^"°, so that, 
indeed, the memory effect is negative. 



6.3 A Michaelis-Menten model 

Non-affine variant of the above examples may be obtained by using Michaelis-Menten dynamics for 
activation and inhibition reactions. For instance, we may write: 

. _ Vi{a - y) _ V2y 
y - K, + {a-yf K. + y'"' 

for some positive constants Vi and K^. Once again, our hypotheses apply, and there is convergence 
to yo. 

We study memory effects for pulses for this example, but only in the special case in which all 
constants are equal to 1 and for a 1-dimensional x-system: 

X — —X + u 

(i-y) y 

y — ; rU X . 

^ l + {l-y) l + y 

We have that yo = 1/2 and xq = uq, and c{y) — —y/{l + y)- We are in the separable situation 
described earlier, and so solve ij — c{y)e~^Uo using separation of variables. Writing 

lny{t) + ln2 + y{t) -1/2 = {- + 1) ds ^ - e'^dsuQ = (e"* - 1)mo 

J\/2 * JQ 

we have, taking limits, that jjuo is the solution of the algebraic equation: 

In jjuo + Vuo = 1/2 - In 2 - uq 

and so decreases with uq. For example, if mq = 1 then jjua ~ 0.24, which is less than one-half of the 
adapted value 7/0 = 0.5. 
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6.4 A carbohydrate uptake system 



The paper [TT] deals with a feedforward motif that appears in one of the carbohydrate uptake sys- 
tems in E.coli, the phosphotransferase system (PTS) for glucose uptake involving phosphoenolpyru- 
vate (PEP). The reactions in this system result in the phosphorylation of Enzyme 11 A. "EllA-P" is 
used to denote the phosphorylated form of this enzyme, which in turn has various regulatory func- 
tions through synthesis of cAMP. A feedforward loop is obtained when viewing u = Glc6P (glucose 
6-phosphate) as input to the system, and using as state variables the concentrations x = TP (triose 
phosphate) and y = PEP. See Figure 2 in that paper: there are positive effects of u on x, and of 
X on y, as well as a countering negative direct effect of u on y that involves the dephosphorylation 
of PEP into Prv via pyruvate kinase. For a simplified analysis following [TT], assuming equation 
(1) from that paper, there results that the output of the system, the concentration of EllA-P, is 
an increasing function of the ratio of concentrations PEP/Prv, where Prv is pyruvate (equations 
(3) and (5) in the citation). The objective of keeping EllA-P approximately constant is achieved 
if the ratio PEP/Prv is kept approximately constant. The model in [TT], Supplemental Materials, 
equations (2,3,11) together with the assumption that equation (1) in the paper holds, provides the 
following equations for x and y: 

X = —ax + bu + a (15a) 
y = ax — puy — (3 (15b) 

assuming that the simplest mass-action model is used for supplemental equation (12) of the ref- 
erence. The constants a and j3 represent uptake rates (supplementary equations (8,9)). In the 
case when a = /? = 0, there results a system of the general form ([2]), with A = a, c{y) = a and 
diy) = —py (affine case). Solutions for constant nonzero inputs have y(t) yo = b/p, and the 
effect of pulses can be analyzed easily. When a and f3 are nonzero, the adaptation property fails, 
although it holds approximately if these numbers are small. However, even for large a, (3, the steady 
state when m is a constant equal to uq is: 

b a — P 

2/0 = - H • 

P puo 

This is still approximately constant, yo ~ b/p, provided that uq be sufficiently large, just as in the 
previous discussion of approximate adaptation. 



6.5 An example of approximate adaptation 

The paper [22] provides the following model of microRNA-mediated feedforward adaptation: 

Pi = aiuj - pipi 

a2pT n 
1 + 

^2 = — — - - jmim2 - ^3^2 
1 + 

P2 = 01^2 - 

where pi,mi,m2,p2,uj are respectively the species concentrations of an "upstream factor", a mi- 
croRNA, a target mRNA, the protein produced by the target mRNA, and an inducer of the upstream 
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factor. The various constants represent transcription, translation, and degradation rates as well as 
well as the efficiency of pairing of the microRNA to its target. (As in the reference, we pick identical 
Hill coefficients for both promoters.) The interest in [29j is in studying the robustness of the steady 
state value of p2. Since this value is directly proportional to the steady state value of m2, we omit 
P2 from the model from now on. Similarly, as is an increasing function of pi, which is in turn 
proportional to u at steady state, we will think of this term as an input "m" and drop the equation 
for pi as well. We are left with the following two-dimensional (mi, 7712) system: 

mi = — 7mim2 — /52mi 
m2 = asM - 7mim2 - /53m2. 

When expressed in the alternative coordinates x = mi — m2 and y = m2, the system has the 
form in Equations (jsj), with ki = as, k2 = 7, ^3 = 02 — as, ^4 = P2, f{y) = (/^s — /32)2/, and 
p{y) = ly^ + /^sZ/- Thus this system exhibits an approximately adaptive behavior for large inputs, 
as discussed in Section |3} In particular, consider the parameter values used in [29j: ai = 0.01, 
a2 = 0.1, as = 0.02, = 0.01, A = 0.001, P2 = 0.0025, ^3 = 0.002, = 0.001, and 7=0.001. 
Then Q{y) = °' aSSlo^oSr^ ^^^^ notations in Section |3| the "adaptation" value for ma 
is a = 0.625 with the "EC50 value" K = Q{a/2) ^ 0.07. The corresponding steady state value of 
P2 is 041112/^4 = 6.25. (Compare Figure 2 in [29].) 



7 Remarks on integral feedback 

The "internal model principle" (see e.g. [21]) states that, if a system perfectly adapts to all step 
inputs, then it may be re-written, possibly after performing a nonlinear change of coordinates, as a 
system in which an integral of the regulated quantity (response variable) is fed-back. A feedforward 
(not feedback) system that exhibits perfect adaptation might appear at ffist sight to be a counter- 
example to this fact. However, there is not necessarily a contradiction, as a change of coordinates 
may allow one to transform a feedforward into a feedback system. This observation was made in [H] , 
and we discuss it further here through an example. 

As an illustration, consider the following two-dimensional linear system: 

X = —X + u (16a) 
ij = —X — ay + u (16b) 

(where "a" is some positive constant). This system has the property, when the input u is constantly 
equal to a value uq, that every solution converges to the state {uq, 0) as t — 00. Thus, the response 
variable y{t) converges to y^ = no matter what is the actual value of Uq. The system response is 
perfectly adaptative. 



The system ( 16 ) has a feedforward form. However, the same system can be recast as an integral 
feedback system, as follows. Suppose that we choose to represent the system using the state variables 
z = X — y and y instead of x and y. In the new set of coordinates: 

z = ay (17a) 
y = —z — (a + l)y + u (17b) 

which can be viewed as a system in which the rate of change of the regulated quantity y depends 
on y itself (proportional negative feedback) as well as on z, which is (up to a positive constant 
multiple) the integral of y (integral feedback term) . 
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Notice that, especially when seen as an integral feedback system, it is immediately obvious that 
for every step input u = Uq (not merely nonzero steps), any steady state has the value ?/ = 0, 
since = i = ay at steady states. So, after a pulse, the system will eventually also converge 
to the adapted value (since we can see the behavior, after the end of the pulse, as the behavior 
corresponding to a zero step). Thus, the memory effect discussed in this note will not occur for a 



true integral feedback system such as the linear system shown above. (Note that the system (16) 



does not have the exact form ^ studied in this paper, because of the additive, not multiplicative, 
term "—ay".) 

As an example, the plot shown in Figure [7]^b) shows the response to the pulse in Figure [7](a), 
for system (16) with a = 0.1. Adaptation to y = results in this case, which also happens with 



the response in Figure [7](d) to the step input in Figure [tJ^c). (Scales for y have been normalized, 
so as to show relative changes. The response in (d) eventually settles back to zero, not shown.) 
Note that the adaptation to the pulse is faster than that for the step input. Interestingly, this 
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Figure 5: Responses to a pulse and to a step input, for a linear feedforward system discussed in the 
text, (a) Pulse input, (b) Response to the input in (a), (c) Step input, (d) Response to the input 



m c . 



model reproduces qualitatively Figure 2 from reproduced as Figure [T] in this paper. The figure 
compares the changes in translocation of CRAC (cytosolic regulator of adenylyl cyclase), reported 
by relative fluorescence of a CRAC-GFP construct, in chemotactic Dictyostelium in response to a 
"short" (i.e., pulse) or a "continuous" (i.e., step) stimulus generated of cAMP. 

The integral feedback form (17) is often said to be more "robust" for adaptation than the 



feedforward form (16), because the steady-state response y is still zero even if the second equation 
is arbitrary modified: if i = and a 7^ 0, one has that ?/ = 0. In contrast, modifications in (16) 
affect the steady state value of y. This claim of robustness is very misleading, however, because 



perturbations of the first equation in (17) will generally change the steady state value of y. 

The connection to the theory in [24j is somewhat subtle. It is shown there that, under appropriate 



*Thc author thanks Pablo Iglesias for pointing out this reference. 



17 



L 
A 




time (sec) 



Figure 6: Reproduced (microscopy inset removed) with permission from Figure 2 in [4j. Responses 
to step and pulse cAMP input in Dictyostelium, as discussed in text. The response to the pulse 
input settles faster than the response to the step. 



technical restrictions on the dynamics, even a nonlinear system that adapts to all step inputs can 
be recast as an integral feedback system. The key is the assumption "all inputs" - the recasting 
may fail to be global when inputs are restricted. Rather than explaining here the nonlinear theory, 
a simple local (linearized) version is analyzed next as an illustration of these ideas. 

Once again, take as an illustration the "sniffer" equations from given in ([s]). For simplicity 
of notations (nothing much changes in the general case), take all kinetic constants equal to one: 

X = —X + u 
y = —yx + u . 

Suppose that one is only interested in studying the behavior of this system in the vicinity of the 
steady state {x,y) = (a, 1) and the step input u{t) = a for all t. For small changes in initial states 
and input values, the system is well-approximated by its linearization around these values, that is, 
the system that is obtained when replacing the nonlinear term "yx" by 

{d{yx)/dx)x + {d{yx)/dy)y, 

where the partial derivatives are understood as evaluated at {x,y). Since d{yx)/dx = y = 1 and 
d{yx)/dy = x = a, we have that the linearized system is precisely the system ( [l6| ). Thus, so long as 
a 7^ 0, the system can be recast (locally) as an integral feedback system. However, in the special case 
when a = 0, the recast system has the form z = 0, y = —z — y + u. This system is not an integral 
feedback system, since z no longer contains information about the integral of y. (Mathematically, 
there is now a zero eigenvalue; thus, the system is no longer asymptotically stable, and hence no 
regulation property holds.) 



8 Discussion 

Adaptation is a feature often exhibited by biological systems, as discussed in the cited references. 
This paper started from the well-known observation that certain types of feedforward circuits pro- 
posed in biological models have adaptation properties, and established rigorous mathematical results 
along those lines. 
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Perhaps of more interest, it was shown that a "memory" effect is often displayed after pulses. 
The magnitude of this effect is a nonlinear function of the magnitude of the pulse, and estimates 
were given of its value. 

One may speculate regarding what beneficial roles these memory effects of pulses might play. 
In at least some of the examples, the calculations show that after a very high-amplitude pulse 
is turned-off, the response settles down to a close to "relaxed" steady state. In the context of a 
complex system, this response might be appropriate, for example, in a situation in which resources, 
used up while responding to a large external input, need to be replenished, and this is achieved by 
turning-off processes controlled by the feedforward circuit; in this way, a "refractory period" would 
be established. 

Of course, the "memory" effect of pulses may or may not play a role in real systems, because 
parameter ranges may be such that the effect is negligible, or because sharp cutoffs of signals are 
rare in nature. It remains to see if feedforward circuits function in these regimes, in any real systems. 

Prom an experimental viewpoint, the results in this paper suggest that one might be able to use 
the pulse-memory property as a way to experimentally distinguish true integral feedback systems 
from feedforward ones, through the testing of system responses against ideal pulses. 
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